Head-mounted display

ABSTRACT

A head-mounted display (HMD) 1, which is operated by a gesture operation performed by a user 3, is provided with a distance image acquisition unit 106 that detects a gesture operation, a position information acquisition unit 103 that acquires position information of the HMD 1, and a communication unit 2 that performs communication with another HMD 1′. A control unit 205 sets and displays an operating space 600 where a gesture operation performed by the user 3 is valid, exchanges position information and operating space information of the host HMD 1 and the other HMD 1 therebetween by the communication unit 2, and adjusts the operating space of the host HMD so that the operating space 600 and an operating space 600′ of the other HMD 1 do not overlap each other.

TECHNICAL FIELD

The present invention relates to a head-mounted display that displays amixed reality image and can be operated by a gesture operation by auser.

BACKGROUND ART

Recently, a head-mounted display (hereinafter, referred to as “HMD”)which has a shape of eye-glasses or goggles and in which mixed realityobjects are superimposed on a real space by projecting mixed realityimages to a portion corresponding to a highly transparent lens, and themixed reality objects can be recognized as actually existing objects hasbeen developed. Patent Document 1 discloses a system that displays ashared virtual object and a private virtual object in a mixed realityenvironment.

In addition, a gesture user interface (gesture UI) that is operated bymovement of a user's hand to perform an operation such as contentviewing initiation and content selection by the HMD is known. The HMDcan be operated with the gesture UI without carrying an operation devicein a hand, and thus convenience is high. However, since the gesture UIis accompanied with movement of a body, in a situation in which a userwho operates an additional HMD is located nearby, there is a concernthat bodies of users may collide with each other due to gestureoperations. To avoid the collision, Patent Document 2 discloses thefollowing configuration. Specifically, the HMD is provided with a deviceinformation notification unit (marker) configured to specify a positionof a host device, a distance or a direction of the marker is detected byphotographing the marker with a camera, and an operating space of theHMD is adjusted so that gesture spaces of a plurality of the HMDs do notoverlap each other.

CITATION LIST Patent Document

-   Patent Document 1: JP 2016-525741 W-   Patent Document 2: JP 2012-108577 A

SUMMARY OF THE INVENTION Problems to be Solved by the Invention

In Patent Document 1, avoidance of collision with another person due toa gesture operation is not considered. In addition, in Patent Document2, avoidance of collision with a person who does not use an HMD is notconsidered. Even in the case of employing a method described in PatentDocument 2, when an HMD of another user faces an opposite direction or ashielding object exists in the middle, a marker provided in the HMD maynot be detected with a camera. In this case, it is difficult tounderstand a distance or a direction of the HMD of the other user, andcollision may occur. In addition, adjustment of the gesture space isperformed only with the host device. Accordingly, when mutual operatingspaces are set to be spaced apart from each other, the operating spacesfor the users may be adjusted to be excessively narrow, and thusconvenience becomes poor.

An object of the invention is to provide an HMD including an operatingspace that is capable of avoiding collision of bodies due to a gestureoperation not only between users who use an HMD but also between a userwho uses the HMD and a user who does not use the HMD, and is easy for auser to use.

Solutions to Problems

According to an aspect of the invention, there is provided ahead-mounted display including: an image projection unit that projectsan image; a see-through lens that superimposes the image projected fromthe image projection unit on a nearby space and displays the image as amixed reality object; a distance image acquisition unit that acquires adistance image and detects a gesture operation by a user; a positioninformation acquisition unit that acquires position information of thehead-mounted display (host HMD); a communication unit that performscommunication with an external terminal; and a control unit thatcontrols an image projection operation by the image projection unit onthe basis of the gesture operation by the user which is detected by thedistance image acquisition unit. The control unit sets an operatingspace where the gesture operation performed by the user is valid anddisplays the operating space as a mixed reality object, performscommunication with another head-mounted display (another HMD) by thecommunication unit to exchange position information and operating spaceinformation of the host HMD and the other HMD, and adjusts the operatingspace of the host HMD so that the operating space of the host HMD and anoperating space of the other HMD do not overlap each other.

In addition, according to another aspect of the invention, there isprovided a head-mounted display including: an image projection unit thatprojects an image; a see-through lens that superimposes the imageprojected from the image projection unit on a nearby space and displaysthe image as a mixed reality object; a distance image acquisition unitthat acquires a distance image and detects a gesture operation by auser, a nearby person, or an object; and a control unit that controls animage projection operation by the image projection unit on the basis ofthe gesture operation by the user which is detected by the distanceimage acquisition unit. The control unit sets an operating space wherethe gesture operation performed by the user is valid and displays theoperating space as a mixed reality object, and in a case where theperson or the object which is detected by the distance image acquisitionunit exists in the operating space, the control unit adjusts theoperating space so that a position at which a detected person or objectexists and the operating space do not overlap each other.

Effects of the Invention

According to the invention, it is possible to provide an HMD includingan operating space that is capable of avoiding collision of bodies dueto a gesture operation not only between users who use an HMD but alsobetween a user who uses the HMD and a user who does not use the HMD, andis easy for a user to use.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a view illustrating an external configuration of an HMD(Example 1).

FIG. 2 is a diagram illustrating a system configuration of the HMD.

FIG. 3 is a view describing a position information acquisition functionof the HMD.

FIG. 4 is a view illustrating a state in which a mixed reality object isdisplayed by the HMD.

FIG. 5 is a view describing various use methods by a user with respectto the HMD.

FIG. 6 is a view illustrating an example of an operation object that isdisplayed with respect to an HMD user.

FIG. 7 is a view illustrating a state in which a user performs a gestureoperation to view contents.

FIG. 8 is a view illustrating a state in which two HMD usersrespectively use HMDs side by side.

FIG. 9 is a view illustrating a case where gesture spaces are moved toavoid collision.

FIG. 10 is a view illustrating a case where the gesture spaces arereduced to avoid collision.

FIG. 11 is a view illustrating a case where a gesture operation isswitched to an operation of a smartphone.

FIG. 12 is a flowchart illustrating a method of adjusting an operatingspace in a case where two HMD users are close to each other.

FIG. 13 is a view illustrating a state in which one HMD user uses theHMD (Example 2).

FIG. 14 is a view illustrating a case where a gesture space is reducedto avoid collision.

FIG. 15 is a view illustrating a case where a part of an object is setto non-display to avoid collision.

FIG. 16 is a flowchart illustrating a case where a display position ofthe object is changed through reduction of the operating space.

MODE FOR CARRYING OUT THE INVENTION

Hereinafter, an embodiment of the invention will be described withreference to the accompanying drawings.

Example 1

In Example 1, description will be given of a configuration in whichcollision of user's bodies due to a gesture operation is avoided in acase where a plurality of HMD users are close to each other.

FIG. 1 is a view illustrating an external configuration of ahead-mounted display (HMD) according to this example. An HMD 1 includessystem storage units 101 a and 101 b which store a control unit, amemory, a storage, or the like, cameras 102 a and 102 b, positioninformation radio wave reception units (position information acquisitionunits) 103 a and 103 b, image projection units 104 a and 104 b whichproject an image of a mixed reality object, see-through lenses 105 a and105 b which reflect a projected mixed reality object in a state of beingsuperimposed on a nearby space, and a distance image acquisition unit106 that acquires a distance image.

Here, a bi-ocular HMD in which right and left images are displayed onright and left see-through lenses 105 a and 105 b by two imageprojection units 104 a and 104 b is illustrated, but a monocular HMDthat displays one image is also possible.

The position information radio wave reception units 103 a and 103 breceive a radio wave signal from a beacon to be described later, andacquire a position of the HMD 1. The distance image acquisition unit 106detects an operation (gesture operation) of a user's hand. In addition,the distance image acquisition unit 106 detects a person or an objectthat exists in front of the HMD 1, and measures a distance or adirection of the person or the object. As a specific example of thedistance image acquisition unit 106, a time of flight (TOF) camera thatmeasures a distance from a flight time of light can be used.

In addition, the HMD 1 is connected to a smartphone 2 having aninter-terminal communication function defined by a specification of 5thgeneration mobile communication through a communication cable 20. Notethat, radio communication such as WiFi and Bluetooth may be used insteadof the communication cable 20. In addition, in a case where the systemstorage units 101 a and 101 b have the communication function defined bythe specification of the 5th generation mobile communication,communication with the smartphone 2 on an outer side is not necessary.

FIG. 2 is a diagram illustrating a system configuration of the HMDillustrated in FIG. 1 . The system storage units 101 a and 101 b of theHMD 1 include a memory 201 that stores various program functional unitsin execution, a storage 202 that stores various pieces of data, aprogram, contents, or the like, a control unit 205 that performsexecution of the program, and a smartphone communication unit 206 thatperforms communication with the smartphone 2, and the constituentselements are connected by a bus 203. In addition, as an input unit 204,an input button, a touch sensor for a fingertip to an HMD frame, or aninput unit by vibration of the HMD frame or the like is provided.

The control unit 205 receives a user's operation through the distanceimage acquisition unit 106, the input unit 204, or the smartphone 2, andcontrols a display operation of an image (content image) by the imageprojection units 104 a and 104 b. In addition, the control unit 205detects that another person (another HMD) exists nearby by the distanceimage acquisition unit 106 or the smartphone 2, and adjusts an operatingspace for a gesture operation to avoid collision of user's bodies.

FIG. 3 is a view describing a position information acquisition functionof the HMD. The HMD 1 can acquire position information of the HMD 1 bybeacons 5 a and 5 b for position information acquisition which areprovided indoors. For example, as in iBeacon (registered trademark), thebeacons 5 a and 5 b for position information acquisition transmit anidentification number of each of the beacons by using a radio technologysuch as Bluetooth (registered trademark) Low Energy. Note that, a beacondevice using Bluetooth (registered trademark) is disclosed in JP2010-130661 A or the like.

The position information radio wave reception units (positioninformation acquisition units) 103 a and 103 b of the HMD 1 receiveradio waves from the beacons 5 a and 5 b and measure intensity of theradio waves to understand a distance from the two beacons 5 a and 5 b.At this time, the HMD 1 receives radio waves by the two positioninformation radio wave reception units 103 a and 103 b, and canunderstand that the HMD 1 is inclined to which direction when viewedfrom the beacons 5 a and 5 b from differential intensity. That is, it ispossible to acquire position information of the HMD 1 based on the twobeacons 5 a and 5 b, and information of a direction of a user 3 who usesthe HMD 1.

In addition, in a case where another user 3′ uses another HMD 1′ in thesame room, it is possible to acquire position information of the otherHMD 1′ based on the beacons 5 a and 5 b, and information of a directionof the user 3′ who uses the HMD 1′. The user 3 and the user 3′ canexchange a plurality of pieces of the position information of the HMDsand a plurality of pieces of the information of the direction which arerespectively acquired by using short-range inter-terminal communication(smartphones 2 and 2′) of the 5^(th) generation mobile communication.

FIG. 4 is a view illustrating a state in which a mixed reality object isdisplayed by the HMD and the HMD 1 is viewed from a left side. A mixedreality object 300 that is projected from the image projection unit 104b is displayed on the see-through lens 105 b. When the mixed realityobject 300 is viewed from an eye 31 of an HMD user, it appears as if themixed reality object 300 is floating in a space in front of the HMD userin an actual nearby background. The mixed reality object 300 may bevarious contents such as image contents, an object for a gestureoperation, and an operating space object. Hereinafter, the objects aresimply referred to as “object”.

FIG. 5 is a view describing various use methods by a user with respectto the HMD.

(1) A spherical object 301 is displayed in front of the eye 31 of theHMD user. The user performs a gesture of moving a hand 32 to touch theobject 301 or to put the object 301 sideway. The distance imageacquisition unit 106 detects that the hand 32 of the user has performedthe gesture with respect to the object 301 at a position of the object301. According to this, the user can perform an operation such asselection, viewing initiation, and viewing stoppage of viewing contentsto be displayed by the HMD 1.

(2) An object 302 having a shape of a smartphone is displayed in frontof the eye 31 of the HMD user. The user performs a gesture of moving thehand 32 with respect to the object 302 as if the user operates an actualsmartphone. The distance image acquisition unit 106 detects that thehand 32 of the user has performed the gesture of operating thesmartphone at a position of the object 302. According to this, as in theoperation with respect to an actual smartphone, the user can perform anoperation such as activation or stoppage of an application, installationof the application, and initiation or termination of communication.

(3) The case of actually operating a touch panel of the smartphone 2connected to the HMD 1 as an operation other than the gesture. An object303 having a shape of a hand is displayed in front of the eye 31 of theHMD user in combination with the object 302 having a shape of asmartphone. At this time, since the object 303 is displayed in a motionlinked to an actual operation on the smartphone 2 by the user, the usercan perform the operation on the HMD without directing a visual line tothe smartphone 2.

In addition, the HMD can also be operated with an input button or atouch sensor through the input unit 204 in FIG. 2 . In addition, whenanother person 4 who does not use the HMD approaches the vicinity of theHMD user, the distance image acquisition unit 106 acquires informationincluding a silhouette of a shape of the other person 4 and a distanceto the other person 4. According to this, it is possible to recognizethat the other person has approached the vicinity, and to recognizethat, for example, a right hand 42 of the approaching person is held outto the HMD user.

Next, description will be given of the basis of a method of viewing themixed reality contents by the HMD.

FIG. 6 is a view illustrating an example of an operation object that isdisplayed with respect to the HMD user. An object (operating spaceobject) 600 indicating a spherical gesture space is displayed at theperiphery of a user 3 who is sitting in a state of wearing the HMD 1.The operating space object 600 indicates a range of a space where agesture operation performed by the user 3 is valid, and it should beunderstood that when exceeding the range, the operation is invalid, andcollision with a body of another person may occur. Objects (operationobjects) 601, 602, and 603 for performing a gesture operation ofselection, viewing initiation, or viewing termination of mixed realitycontents (hereinafter, simply referred to as “contents”) desired to vieware displayed at the inside of the operating space.

FIG. 7 is a view illustrating a state in which the user performs thegesture operation and views a content. For example, a desired content isselected by performing a gesture in which the hand 32 of the user 3touches the operation object 601. In this state, a corresponding mixedreality content 701 is displayed in front of the user 3, and the user 3can initiate viewing.

Next, description will be given of a configuration for avoidingcollision of bodies of users due to a gesture operation in a case wherea plurality of HMD users are close to each other.

FIG. 8 is a view illustrating a state in which two HMD usersrespectively use HMDs side by side. Operating space objects 600 and 600′indicating respective gesture spaces are displayed at the periphery ofHMD users 3 and 3′. Note that, the operating space objects 600 and 600′are indicated by an outermost peripheral circle (one-dot chain line) toavoid complication of the drawing. In this case, HMDs 1 and 1′ maydisplay only an own gesture space with respect to each user, but maydisplay a gesture space of another user in combination. This can berealized by exchanging information of a position or a size of thegesture spaces between the HMDs by using an inter-terminal communicationfunction (smartphones 2 and 2′) of the 5^(th) generation mobilecommunication. According to this, the user 3 can view not only the ownobject 600 but also the object 600′ for the user 3′.

Operation objects 601 to 603 and 601′ to 603′ for performing a gestureoperation of selection, viewing initiation, or viewing termination ofcontents are displayed in an operating space. Note that, display of acontent that is being viewed is omitted to avoid complication of thedrawing.

For example, the user 3 or 3′ may perform an operation of putting acorresponding object (here, 601 or 603′) sideway with a hand 32 or 32′to stop viewing of a content that is being viewed. In a case where adistance between two persons is short, there is a concern that the hands32 and 32′ may collide with each other.

FIG. 9 is a view illustrating a case where gesture spaces are moved toavoid collision. The gesture spaces (objects 600 and 600′) with respectto two HMD users 3 and 3′ are moved in directions to be spaced apartfrom each other to avoid overlapping of the operating spaces. Inaddition, display positions of the objects (601 to 603 and 601′ to 603′)for the gesture operation are moved, and the gesture operation isprompted to be performed by using a hand 33 or 33′ on a side distantfrom the users different from each other. According to this, it ispossible to avoid collision of hands of the users 3 and 3′ close to eachother.

FIG. 10 is a view illustrating the case of reducing the gesture spacesto avoid collision. Sizes of the gesture spaces (objects 600 and 600′)with respect to the two HMD users 3 and 3′ are reduced to avoidoverlapping of the gesture spaces. In addition, sizes of the gestureoperation objects (601 to 603 and 601′ to 603′) are reduced to enter thereduced gesture spaces, and display positions are set to be close toeach other. Note that, when reducing the size of each of the gesturespaces, the gesture space may be reduced in a state of being a sphericalspace, or the operating space may be limited to the lower half of aspherical space or a shape of the operating space may be modified to aspheroid. According to this, it is possible to avoid collision of handsof the users 3 and 3′ close to each other.

In the case of performing movement or reduction of the operating spacesas in FIG. 9 or FIG. 10 described above, operating space information isexchanged between the HMDs 1 and 1′ through the inter-terminalcommunication function (smartphones 2 and 2′), a determination is madeas to whether or not the operating spaces overlap each other, and newoperating spaces are determined to avoid overlapping. That is, the HMD 1and the HMD 1′ can detect that the HMD 1 and the HMD 1′ are locatednearby by the inter-terminal communication function. Accordingly, evenin a case where a counterpart HMD faces any direction, or a shieldingobject exists in the middle, overlooking does not occur. In addition,both the HMDs 1 and 1′ determine the operating spaces in conjunctionwith each other, and thus the operating spaces after adjustment can beset to an optimal size without being excessively narrow.

FIG. 11 is a view illustrating a case where the gesture operation isswitched to an operation by a smartphone. Even when performingadjustment of the gesture spaces, in a case where it is difficult toavoid collision of hands of the users 3 and 3′, the HMDs 1 and 1′terminate display of the operating space objects 600 and 600′ withrespect to the users 3 and 3′, and give a notification indicating thatan operation by a gesture is not accepted. In addition, the users 3 and3′ perform switching to an operation by real smartphones 2 and 2′. Inthis case, smartphone-shaped objects 611 and 611′ and hand-shapedobjects 612 and 612′ for operating the smartphones by mixed reality aredisplayed in front of the users 3 and 3′. In addition, when operatingreal smartphones 2 and 2′ with hands 32 and 32′, display positions ofthe hand-shaped objects 612 and 612′ are moved in conjunction withmovement of the operating hands 32 and 32′. According to this, the users3 and 3′ can operate the smartphones without directing a visual line tothe real smartphones 2 and 2′. According to this, for example, it ispossible to perform an operation of selection, viewing initiation, orviewing termination of contents by operating smartphones 2 and 2′ in apocket.

FIG. 12 is a flowchart illustrating a method of adjusting the operatingspaces in a case where two HMD users are close to each other. Here,description will be given of a case where the display positions of theobjects are changed by movement of the gesture spaces as described inFIG. 9 . Note that, this flow is repetitively executed by the controlunit 205 when the user 3 is using the HMD 1.

S801: The HMD 1 acquires position information (including a direction ofthe HMD 1) of the host HMD 1 by the position information radio wavereception units 103 a and 103 b.

S802: The HMD 1 exchanges position information (including a direction)of the HMD, and gesture space information (a position and a size) with anearby HMD 1′ by using short-range inter-terminal communication of the5^(th) generation mobile communication through the smartphone 2.According to this, position information of the nearby HMD 1′ andoperating space information are acquired.

S803: A determination is made as to whether or not operating spaces ofthe nearby HMD 1′ and the host HMD 1 overlap each other on the basis ofthe obtained information of the position and the size of the operatingspace from the nearby HMD 1′. In a case where the operating spaces donot overlap each other, the process is terminated. In a case where theoperating spaces overlap each other, the process proceeds to S804.

S804: Positions at which the operating spaces do not overlap each otherare calculated by moving the operating space of the host HMD 1 in adirection to be spaced apart from the operating space of the nearby HMD1′.

S805: Position information of a calculated operating space is exchangedwith the nearby HMD 1′ by short-range inter-terminal communication. Atthis time, operating space position information which is calculated bythe nearby HMD 1′ is acquired from the nearby HMD 1′.

S806: A determination is made as to whether or not overlapping with theoperating space of the host HMD 1 after calculation occurs on the basisof the position information of the operating space after calculationwhich is acquired from the nearby HMD 1′. In a case where the operatingspaces do not overlap each other, the process proceeds to S807. In acase where the operating spaces overlap each other, the process returnsto S804, and positions at which the operating spaces do not overlap eachother are calculated again. In addition, the process is repeated untilthe operating spaces do not overlap each other in the determination inS806.

S807: Positions of operation objects for performing a gesture operationwith respect to contents are determined and the operation objects aredisplayed in the operating spaces after calculation.

S808: Objects indicating new gesture spaces are displayed in accordancewith a position change of the operating spaces.

S809: New detection regions at the time of detecting a gesture operationby the distance image acquisition unit 106 are set in accordance withthe position change of the operating spaces.

S810: Since the operating spaces do not overlap each other between theHMD 1 and the nearby HMD 1′, the operating spaces, the display positionsof the operation objects, and the detection regions of the gestureoperation are returned to initial values.

In the flowchart, description has been given of a case where the gesturespaces are moved to avoid collision, but this is also true of the caseof reducing the gesture space. Alternatively, adjustment can also bemade in combination of both the cases.

In addition, in the example, it is assumed that two HMD users are closeto each other, but this is also true of a case where a plurality of (twoor more) HMD users are close to each other.

According to Example 1, in a case where the plurality of HMD users areclose to each other, it is possible to avoid collision of bodies ofusers due to the gesture operation. At this time, it is possible toprovide an HMD that reliably detects an HMD that exists nearby andincludes an operating space that is easy for a user to use.

Example 2

In Example 2, description will be given of the case of avoidingcollision of a user who uses an HMD with a body of a user who does notuse the HMD.

FIG. 13 is a view illustrating a state in which one HMD user uses theHMD. A user 3 is performing a gesture operation for content viewing. Inan operating space object 600, operation objects 601 to 603corresponding to a first group of contents, and operation objects 604 to606 for a second group of contents are displayed in parallel. Forexample, a user 3 is in a state in which the user 3 performs a gestureoperation with respect to the object 601 with a hand 32, and displaysand views a selected content 701. In this state, a case where a personwho does not use the HMD has approached the user 3 will be assumed.

FIG. 14 is a view illustrating the case of reducing a gesture space toavoid collision. In some cases, another person 4 who does not use theHMD approaches the HMD user 3 from a front side, enters a gesture space(object 600), and approaches display positions of the objects 604 to606. At this time, when the user 3 performs a gesture operation withrespect to the objects 604 to 606, bodies of the user 3 and the otherperson 4 may collide with each other.

To avoid the collision, the HMD 1 identifies approaching of the otherperson 4 from information of the distance image acquisition unit 106. Inaddition, a size of the gesture space (object 600) is reduced to a rangein which collision does not occur. In addition, the operation objects604 to 606 which do not enter the operating space due to the reductionare moved to another position inside the operating space. In thisexample, the movement is made to a position on a right side of thecontent 701 that is being viewed. According to this, it is possible toavoid collision of bodies of the user 3 and the other person.

In the above-described example, description has been given of an examplein which the gesture space is reduced and the operation objects aremoved to avoid collision, but is also possible to cope with thecollision by movement of the gesture space or reduction of the operationobjects.

As described above, in the case of performing reduction or movement ofthe operating space, a distance or a direction to the other person 4 ismeasured by the distance image acquisition unit 106, and a new operatingspace is determined so that a position of the other person 4 and theoperating space do not overlap each other. In addition, it is needlessto say that not only a person but also an object is set as a target withwhich collision is to be avoided.

FIG. 15 is a view illustrating a case where a part of an object is setto non-display to avoid collision. When reducing the gesture space(object 600) as illustrated in FIG. 14 , an object that does not enterthe gesture space may occur. In this case, partial objects (here, 604 to606) are set to non-display. In addition, an operation corresponding tothe objects set to non-display is switched to another operation such asthe smartphone 2. In this case, the user 3 is notified of limitation oftargets of the gesture operation. According to this, it is possible toavoid collision of bodies of the user 3 and the other person.

FIG. 16 is a flowchart illustrating a method of adjusting the operatingspace in a case where another person who does not use the HMD approachesthe HMD user. Here, description will be given of a case where thedisplay positions of the objects are changed through reduction of thegesture space described in FIG. 14 . Note that, this flow isrepetitively executed by the control unit 205 when the user 3 is usingthe HMD 1.

S901: The distance image acquisition unit 106 of the HMD 1 acquires adistance image on a front side.

S902: A determination is made as to whether or not a person or an objectexists in the gesture space from the distance image that is acquired. Ina case where the person or the object does not exist in the operatingspace, the process proceeds to S907. In a case where the person or theobject exists in the operating space, the process proceeds to S903.

S903: A size of the operating space is calculated so that a position atwhich the person or the object exists and the operating space do notoverlap each other. In a calculation method, for example, calculation isperformed by reducing a radius of a spherical operating space and bychecking whether or not overlapping with the person or the object tooccur.

S904: Operation objects for performing a gesture operation are displayedin the operating space that is calculated. Display positions at thistime are set to positions as far as possible from the person or theobject shown in the distance image. For example, spaces on an upperside, on a lower side, on a left side, and on a right side around acontent that is being viewed are remembered as candidates for thedisplay positions, and among the candidates, positions as far aspossible from the person or the object shown in the distance image areselected.

S905: An object indicating a new gesture space is displayed inaccordance with a size change of the operating space.

S906: A new detection region at the time of detecting the gestureoperation by the distance image acquisition unit 106 is set inaccordance with the size change of the operating space. Accordingly,adjustment of the operating space is terminated.

S907: Since the person or the object does not exist in the operatingspace, the size of the operating space, the display positions of theoperation objects, and the detection region of the gesture operation arereturned to initial values.

In the flowchart, description has been given of a case where the gesturespace is reduced to avoid collision, but this is also true of the caseof moving the gesture space. Alternatively, adjustment can also be madein combination of both the cases.

Note that, in the example, description has been given of a case wherethe HMD user is sitting, but an application may be made to use in a casewhere the user is standing or walking. Particularly, in use whilewalking, even in a case where another person is not in the gesturespace, it may be expected that the other person enters the operatingspace when the walking continues. At that time, a warning may be issuedto a user by a method such as displaying of a warning object oroutputting of a warning sound. In addition, in the case of outputtingthe warning sound, an identification may be made as to whether or not anapproaching person is an adult or a child from the distance imageobtained by the distance image acquisition unit, and a priority may begiven to a time when issuing a warning in the case of the child, forexample, the warning may be issued early.

According to Example 2, it is possible to provide an HMD including anoperating space that is capable of avoiding collision of bodies betweena user who uses the HMD and a nearby person who does not use the HMD dueto a gesture operation, and is easy for the user to use.

REFERENCE SIGNS LIST

-   1, 1′ Head-mounted display (HMD)-   2, 2′ Smartphone-   3, 3′ User-   4 Another person-   5 a, 5 b Beacon for position information acquisition-   20 Communication cable-   32, 32′, 33, 33′ User's hand-   101 a, 101 b System storage unit-   102 a, 102 b Camera-   103 a, 103 b Position information radio wave reception unit    (position information acquisition unit)-   104 a, 104 b Image projection unit-   105 a, 105 b See-through lens-   106 Distance image acquisition unit-   201 Memory-   202 Storage-   203 Bus-   204 Input unit-   205 Control unit-   206 Smartphone communication unit-   300 to 303 Mixed reality object-   600, 600′ Operating space object-   601 to 606 Operation object-   611 Object of smartphone-   612 Object of user's hand-   701 Mixed reality content

1. A display apparatus comprising: a projector configured to project animage; a display configured to superimpose the image projected from theprojector on a nearby space and display the image as a mixed realityobject; a receiver configured to receive position information of thedisplay apparatus; a communication interface configured to communicatewith another apparatus; and controlling circuitry; wherein thecontrolling circuitry is configured to set a first operating space inwhich a gesture operation of a user of the display apparatus may beperformed and control the display so as to display the first operatingspace as the mixed reality object, wherein the communication interfaceis configured to acquire information of a position and an operatingspace of the another apparatus, wherein, if the controlling circuitrydetermines that the first operating space overlaps with the operatingspace of the another apparatus based on the position informationreceived by the receiver and the information of the position and theoperating space of the another apparatus acquired by the communicationinterface, the controlling circuitry is configured to calculate a secondoperating space which does not overlap the operating space of theanother apparatus and control the display so as to display the secondoperating space; wherein, if the controlling circuitry determines thatthe first operating space does not overlap with the operating space ofthe another apparatus based on the position information received by thereceiver and the information of the position and the operating space ofthe another apparatus acquired by the communication interface after thesecond operating space is displayed, the controlling circuitry isconfigured to return the first operating space from the second operatingspace and control the display so as to display the first operatingspace.
 2. The display apparatus according to claim 1, wherein the secondoperating space is calculated by any of position movement, sizereduction, and shape change of the first operating space, or incombination of the position movement, the size reduction, and the shapechange.
 3. The display apparatus according to claim 1, wherein thedisplay is configured to display an operation object in order for a userto perform an operation of selection, display initiation, or displaytermination of a display image as a mixed reality object, and wherein,if the second operating space is displayed, the controlling circuitry isconfigured to control the display to move a position or reduce a size ofthe operation object so that the operation object enters within thesecond operating space.
 4. The display apparatus according to claim 1,wherein the display apparatus is a head-mounted display.
 5. A displayapparatus comprising: an image projection unit that projects an image; adisplay unit that superimposes the image projected from the imageprojection unit on a nearby space and displays the image as a mixedreality object; a position information acquisition unit that acquiresposition information of the display apparatus; a communication unit thatcommunicates with another apparatus; and a control unit; wherein thecontrol unit sets a first operating space in which a gesture operationof a user of the display apparatus may be performed and controls thedisplay unit so as to display the first operating space as the mixedreality object, wherein the communication unit acquires information of aposition and an operating space of the another apparatus, wherein, ifthe control unit determines that the first operating space overlaps withthe operating space of the another apparatus based on the positioninformation acquired by the position information acquisition unit andthe information of the position and the operating space of the anotherapparatus acquired by the communication unit, the control unitcalculates a second operating space which does not overlap the operatingspace of the another apparatus and controls the display unit so as todisplay the second operating space; wherein, if the control unitdetermines that the first operating space does not overlap with theoperating space of the another apparatus based on the positioninformation acquired by position information acquisition unit and theinformation of the position and the operating space of the anotherapparatus acquired by the communication unit after the second operatingspace is displayed, the control unit returns the first operating spacefrom the second operating space and controls the display unit so as todisplay the first operating space.
 6. The display apparatus according toclaim 5, wherein the second operating space is calculated by any ofposition movement, size reduction, and shape change of the firstoperating space, or in combination of the position movement, the sizereduction, and the shape change.
 7. The display apparatus according toclaim 5, wherein the display unit is configured to display an operationobject in order for a user to perform an operation of selection, displayinitiation, or display termination of a display image as a mixed realityobject, and wherein, if the second operating space is displayed, thecontrol unit is configured to control the display unit to move aposition or reduce a size of the operation object so that the operationobject enters within the second operating space.
 8. The displayapparatus according to claim 5, wherein the display apparatus is ahead-mounted display.